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Abstract 

Testing subject has many subsets and connections. One important issue is how to assess or measure students or learners. 
What would be our tools, what would be our style, what would be our goal and so on. So in this paper the author 
attended to the style of testing in school and other educational settings. Since the purposes of educational system have 
been changed, there have been some inevitable changes in testing style. Therefore, in recent years, computer-based 
testing (CBT) has grown in popularity and will likely become the primary mode for delivering tests in the future. So 
different aspects of computer-based tests and paper-and-pencil based tests like motivation, anxiety and students’ 
performance with different styles will be reviewed in this paper. 
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1. Introduction 

Dillon published his critical review of the empirical literature on reading from paper vs. screen in 1992 and investigated 
the equivalence of computer- and paper. Many test experts are exploring the possibility of transitioning from a paper 
and pencil mode of test administration to a computer based test (CBT) mode. 

Administration as an important factor in testing should be attended to in changing the mode of it, especially in creating 
questions as to whether or not the tests, and test scores derived from those tests, are equivalent, and whether there are 
effects of the testing mode. 

Comparative studies are conducted to determine if such mode effects exist, and if scores derived from the same test in 
two different modes are comparable and can be used interchangeably. 

In recent years, computer-based testing (CBT) has grown in popularity and will likely become the primary mode for 
delivering tests in the future. Computers revolutionized the world of training and development. Many investigators such 
as Fuhrer (1973) began researching on many points of mode which has enhanced training through computers. Many 
studies focused on the effects of using computers in the classroom for testing on various aspects of the learning 
environment such as student anxiety, teacher attitudes, student achievement and more. The advantages of computers are 
well known and apparent (Al-Amri, 2009). It seems that the integration of computers has increased the productivity and 
innovation in the area of testing. The standardization of test administration conditions is one of the benefits offered by 
Computer- Based Testing (CBT). No matter what the tests’ population size is, CBT helps test developers to set the same 
test conditions for all participants. Al-Amri (2009) also believed that CBT improves all aspects of test security by 
storing questions and responses in encrypted databases and enables testers to create randomized questions and answers 
from vast question pools. Internet based assessment is one type of CBT, and the researchers in the field of psychology 
are doing the personality tests on internet. There are some studies on internet versus paper and pencil formats in 
psychological tests (Buchanan, 2000, 2001, 2002; Buchanan et al., 2005; Buchanan & Smith, 1999) Low cost and 
access to a greater number of subjects in much less time are some of the advantages of the on-line-administration. In 
addition, data entry requirements are largely eliminated, and the potential for errors in data entry is largely reduced 
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(Barak & English, 2002; Buchanan, 2006). Most of the authors (Chuah, Drasgow, & Roberts, 2006; Davis, 1999; 
Gosling, Vazire, Srivastava, & John, 2004) are positive about the relationship between the equivalence and similarity 
properties of the traditional paper and on-line formats of personality questionnaires. 

There are some studie (e.g. Buchanan et al., 2005; Buchanan & Smith, 1999) on the effect of computer-administered 
testing on the learner. Many others, however, are focused on the differences between computerized tests and traditional 
paper and pencil tests without considering the effects on the learners adequately. Some studies are inconclusive. The 
1988 statewide field test compared reading, writing, and computation scores for approximately 1,000 students. 

Many studies (Chuah, Drasgow, & Roberts, 2006; Gosling, Vazire, Srivastava, & John, 2004) found significant 
differences between computer-administered testing and traditional paper and pencil testing. These studies and articles 
attributed achievement differences to several factors. Russell and Haney (1996) found significant differences in the 
performance of students on the National Assessment of Educational Progress computerized tests when compared to 
traditional paper and pencil tests. They compared 42 students tested on a computer-administered test with scores of 47 
students tested on a traditional paper and pencil test. In addition to answering multiple-choice items, there were open- 
ended items requiring original responses. For scoring, raters only saw the computer products because ah hand-written 
responses were entered into the computer verbatim after the test concluded. Larger mode effects were found on open- 
ended writing tasks than on multiple-choice tests. Additionally, analysis showed that students who wrote on the 
computer tended to organize their work into paragraphs and wrote responses nearly twice as long as the students who 
hand wrote their responses. 

Karadeniz (2009) studied the impact of paper based, web based and mobile based assessment on students’ achievement. 
A group of 38 students was experimented for 3 weeks. Significant differences were found between the scores achieved 
by the students in second week, but not in the first week. The authors perceived that students had positive attitude 
towards web based, mobile-based assessment due to ease of use, comprehensive, and instant feedback. Moreover, most 
favored tests were web-based and the least favored were paper-based. 

In another experimental research, Bodmann and Robinson (2004) conducted an experimental study to compare speed 
and performances differences between computer-based (CBTs) and paper-pencil tests (PPTs). Both CBTs and PPTs 
contained 30 MCQs items with 35 minute of time limit. Approximately half the class (i.e. 28 students) took the first test 
on the computer and the rest preferred first test on paper. Procedures shifted for the second tests, with the first group 
receiving PPTs and second group received CBTs after two weeks. It was concluded that undergraduates completed the 
CBT faster than PBT with no difference in scores. 

In fact, many research works have been conducted to evaluate the comparability of computer-based assessment and 
paper and pencil based assessment. Some studies revealed that there is a significant difference between the two testing 
modes on test scores (e.g. Scheuermann & Bjornsson, 2009; Choi, Kim, & Boo, 2003), while other studies reported 
opposite or inconsistent results (e.g. Al-Amri, 2009; Boo, 1997). However, unlike the abundance of CBA research done 
with older or special needs students, there is a dearth of available research focusing on the issues of computer-based 
assessment with typically developing young children (Barnes, 2010). 

2. Anxiety and Motivation comparing between CBT and P&PBT 

Some studies (Buchanan et al., 2005; Gosling, Vazire, Srivastava, & John, 2004) examined the anxiety level of the test 
taker and the time required to complete the examination. Wise (1997) contemplated test administration from the 
perspective of the examinees during a computerized adaptive test and focused on issues surrounding the development of 
computerized-adaptive tests. The author examined how the ability to review answers affected examinees’ anxiety and 
performance levels. Another issue interwoven with that of item review was the time limits on the test takers. He 
believed that because a computerized-adaptive test was usually shorter than a traditional paper and pencil test, 
computerized-adaptive test developers should be either be extremely liberal when establishing time limits or impose no 
time limits at ah. Increased test anxiety, higher or lower examinee motivation, and equity in computer experience, he 
wrote, ah have implications when considering inferences made from computerized-adaptive test scores and should be 
carefully weighed when developing computerized-adaptive tests. 

Test anxiety was not the only emotion reported to affect test takers. Motivation levels also affected achievement. 
Feedback and knowledge of results were indicated as significant in several studies. Betz and Weiss (1976) tested 350 
college students divided into high- and low-ability groups. Their reported motivation levels were found to be related to 
their ability level. Motivational differences were attributed to having immediate knowledge of test results, which 
resulted in greater standardization of the test-taking environment in a computer-adaptive test mode than in traditional 
paper and pencil testing environments. 

3. CBT and P&PBT and its effect on Students’ performance 

The benefits of performance testing are well documented: Ayala, Shavelson, Lin and Shultz (2002) argue that science 
performance assessments can measure different types of knowledge including declarative, procedural and schematic 
knowledge. Ruiz-Primo and Shavelson (1996) say that performance tests produce high level of reasoning processes, 
since these tests are closely related to what students and scientists do in the lab. Haertel (1999) argues that these tests 
not only show how students learn, but also show the higher engagement of students in learning. Elliot (1995) argues that 
performance assessments provide evidence of what students know and are able to do. Quellmalz (1999) says that the 
evidence gathered during the performance provides insights to students' thinking, and at the same time introduces 
students to authentic real-world problems, which allows them to show how they can apply academic knowledge to 
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practical situations. For the reasons mentioned above performance assessment tests are alternatives to measure students' 
knowledge in electrical circuits. 

4. Conclusion 

Based on the above-mentioned discussions and reviews we can conclude that the difference of testing style in different 
situation has different conclusions and aspects. As the goals in testing have been changed, the styles should be changed 
to get better results. 
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